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Linear  Control  Processes  and  Mathematical  Programming 

by  George  B.  Dantzlg 


Linear  Control  Process  Defined  [1],  [2]: 

We  shall  consider  an  "object"  defined  by  its  n  +  1 

coordinates  x  =  (xQ,  Xj,...,xn)  whose  "motion"  described  as 

« 

a  function  of  a  parameter  "time"  (t)  can  be  written  as  a 
linear  system  of  differential  equations: 

( 1 )  *  A*x  +  B^i 

where  A* ,  B  are  known  matrices  that  may  depend  on  t  and 
u  «  (u1 ,  Ug,...,^)  is  a  control  vector  that  must  be  chosen 
from  a  convex  set,  u  €  U( t)  for  every  0  <  t  <  T.  The  time 
period  0  <  t  <  T  is  fixed  and  known  in  advance.  The  coor¬ 
dinate  Xq  *  Xg(t)  represents  the  "cost"  of  moving  the  object 
from  its  initial  position  to  xQ(t).  For  this  purpose  it  may 
be  assumed  that  Xq(0)  =  0.  Defining 

(2)  x  -  (0,  x,.  Xj . xn) 

the  object  is  required  to  start  somewhere  in  a  convex  domain 
x(0)  e  SQ  and  to  terminate  at  t  =  T  somewhere  on  another 
convex  domain  x(T)  €  ST. 

Problem:  Find  u  e  U(t)  and  boundary  values  x(0)  e  SQ, 
x(T)  e  S^,  such  that  Xq(T)  is  minimized. 

Assuming  u  e  U(t)  is  known,  the  system  of  differential 
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equations  can  be  Integrated  to  yield  an  expression  for  X(T) 
in  terms  of  X(0)  and  u  e  U(t).  This  is  true  in  general  but 
will  be  illustrated  for  the  case  when  and  do  not  depend 
on  t;  in  this  case 

(3)  X(T)  =  eTAX(0)  +  u(t)dt 

where  u(t)  e  U(t)  is  a  convex  set  and  where  we  assume  the 
integral  exists  whatever  be  the  choice  of  the  u(t)  c  U(t) 
for  0  <  t  <  T. 

Generalized  Linear  Program  [3l? 

Our  general  objective  is  to  illustrate  how  mathematical 
programming  and,  in  particular,  how  the  decomposition  principle 
in  the  form  of  the  generalized  linear  program  can  be  applied 
to  this  class  of  problems.  An  elegant  constructive  theory 
emerges,  [4]. 

A  generalized  linear  program  differs  from  a  standard 
linear  program  in  that  the  vector  of  coefficients,  say  P, 
associated  filth  any  variable  n  need  not  be  constant  but  can 
be  selected  from  a  convex  set  C.  For  example: 

Problem:  Find  Max  X,  y,  >  0  such  that 

(4)  UQX  +  P|i  = 

H  =  1 

where  UQ,  Qq  are  specified  vectors  and  P  c  C 
convex. 
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The  method  of  solution  assumes  we  have  initially1  on  hand 
m  particular  choices  e  C  with  the  property  that 


(5) 


V  +  pih  +  P2^2  +“*+Pmhn  =  % 


Hi  +  H2 


+. . .  + 


=  1 


has  a  unique  "feasible"  solution;  that  is  to  say  \  * 
Pl  ■  ji®  >  0  and  the  matrix 


(6) 


Bo  .  [U°  '  •"  F"  ] 

1  o  i  ...  1  J 


is  non-singular  (i.e.  the  columns  of  B°  form  a  basis).  Because 
Pi  €  C,  the  vector  P°  =  I  constitutes  a  solution  P  =  P° 

for  (4)  except  that  1=1°  may  not  yield  the  maximal  x* 

To  test  whether  or  not  P°  is  an  optimal  solution  one 
determines  a  row  vector  tt  =  tt°  such  that 


(7) 


tt°B°  *  (1,  0,...,0) 


and  then  a  value  6  and  a  vector  P_,,  e  C  such  that 

m+i. 


(8) 


6  ■  TT°P. 


m+1. 


TT°P 


where  we  denote 


This  is  not  a  restrictive  assumption  since  there  is  an 
analogous  method  for  obtaining  such  a  starting  solution,  see 


[4] 
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.«  •»-*»>/•  nr-*  -» 


(9)  P  -  [  *  ] 

0 

If  it  turns  out  that  6  =0,  then  P  =  P  is  an  optimal  solution. 

If  P°  is  not  optimal,  system  (5)  is  augmented  by  Pffi+^ . 
After  one  or  several  iterations  k  the  augmented  system  takes 
the  form  of  a  linear  program: 

Problem:  Find  Max  x,  >  0 

m+k 

(10)  V  + 1  Vl  -  % 

1 

m+k 

I  Mi  -  1 
1 
lr 

Letting  B  denote  the  basis  associated  with  an  optimal  basic 

k  k 

feasible  solution  ^  to  (10),  tt  is  defined  analogous 

to  (7)  and  6k+1  and  I>Tn+k+1  analogous  to  (8).  If  it  turns 

out  that  6=0,  the  solution 

m+k 

(11)  P*  =  I 

is  optimal.  If  not  the  system  is  augmented  by  Pm+^+-j  and 
the  iterative  process  is  repeated. 

It  is  known  under  certain  general  conditions  such  as  C 
bounded  and  the  initial  solution  is  non-degenerate  (i.e.  |i^>0), 

-k  -#  lr  #  \  % 

that  rr  ->  tt  and  r  -»  P  on  some  subsequence  k  and  that  P  *  P 

_# 

is  optimal.  The  two  fundamental  properties  of  it  are 

(12)  tt*  t  0  and  tt*?  >  tt*?*  =  0  for  all  P  €  C. 
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The  entire  process  can  be  considered  as  constructive 
providing  it  is  not  difficult  to  compute  the  various  I5m+jc+1 
from  (8)  with  tt  =  rrm+k.  Another  point  is  that  the  iterative 
process  terminates  in  a  finite  number  of  steps  if  C  is  a 
convex  polyhedral  set  and  Pm+k  constitute  extreme  solutions 
from  it.  In  all  cases  an  estimate  is  available  on  how  close 
the  k  solution  is  to  an  optimal  value  of  \ . 


Application  of  the  Generalized  Program  to  the  Linear  Control  Process 
Let  us  denote 

(13)  P  =  F  e^”1^  u(t)dt 

0 


and  note  that  P  is  an  element  of  a  convex  set  generated 


by  choosing  all  possible  u(t)  €  U(t).  We  specify  that 
Uq  *  (l,  and  denote  by  \  -  -Xq(T),  where  XQ(l 
is  the  coordinate  of  X(T)  to  be  minimized.  Then 


(l4)  X(T)  =  -U0X  +  X(T) 


We  further  define  Qq  by 

(15)  X(T)  =  eTAX(0)  +  Qq  . 

p 

Substitution  of  these  into  (3)  formally  converts  the 
integrated  form  of  the  control  problem  into  a  generalized 
linear  program  (4). 


- - 

Actually  Qu  is  not  given  but  is  an  element  of  a  convex  set. 
To  simplify  the  discussion  which  follows  we  assume  CL  is 
a  fixed  vector. 
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Each  cycle  of  the  iterative  process  yields  a  known  row 


vector,  which  we  partition 
(16)  Trk+1  =  Ctt  ,  6] 


where  tt  represents  it  first  n  +  1  components  corresponding 
to  P  and  0  its  last  component.  Since  tt  is  known,  our  choice 


for  Wi  is 


( 17) 


ttP. 


m+k+1 


=  Min  {f.  e^T“t^AB  u(t)i 

=  J  JmIii  tt  e^T”t^A3  u(t) 
0  |ueU( t) 


>  dt 


where  clearly  the  minimum  is  obtained  when,  in  ( 1 6) ,  the 
integrand  for  each  t  is  selected  to  be  minimum. 

Note  that 


(18) 


V  ,  TT 


is  a  row  vector  that  can  be  computed  for  each  t.  For  example, 
0+  can  be  represented  by  a  finite  sum  of  vectors  whose 

«  ,TT 

weights  depend  on  t  and  the  eigen  values  of  A.  The  new 
extremal  solution  Pm+k+i  is  obtained  by  choosing  the  control 
which  minimizes  the  linear  form  in  u  for  each  t  ;  i.e. ,  find 


(19)  Min(0+  u)  ,  u  c  U(t)  . 

w  jTT 

For  example  if  U(t)  is  a  polyhedral  set  then  (19)  is  a  linear 
program.  If  U(t)  is  the  same  for  all  t  ,  then  only  the 


objective  form,  0.  u  ,  varies  for  different  t  ;  except  for 

m  ,TT 

the  objective  form  the  linear  programs  are  the  same  for  all  t  . 

If  optimal  tt  is  used,  then  the  optimal  control  u  (except 
for  a  set  of  measure  zero)  satisfies 

(20)  Min[0*(t)u]  ,  u  e  U(t) 

where  0*(t)  =  Tr*e^T“'t^AB  .  Pontryagin  refers  to  this  as 
the  maximal  principle.  It  is,  as  we  have  just  shown,  also 
a  consequence  of  the  decomposition  principle  of  linear  program¬ 
ming. 

Conclusion: 

In  our  approach  the  general  control  obtained  for  each 

cycle  is  a  linear  combination  of  exactly  n+1  special  controls 

obtained  by  minimizing  for  each  t,  the  linear  expression  (19) 

in  u  for  n+1  choices  of  n  .  These  special  controls  may  be 

referred  to  as  extreme  controls.  The  latter  each  in  themselves 

do  not  maintain  feasibility,  that  is  to  say  guarantee  that 

the  object  will  move  from  X(o)  to  X(T).  Each  new  linear 

combination  of  these  special  controls  will,  however,  gener- 

■a 

ate  a  new  feasible  control  with  a  lower  valueJ  for  the  total 
cost  Xq(T).  Under  conditions  stated  this  iterative  process 
is  known  to  converge. 


If  basic  solution  is  non-degenerate. 
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The  Lurie  Problem  On  Nonlinear  Controls 
by  Solomon  Lefschetz 

Some  twenty  five  years  ago  the  mathematical  world  was  presented 
by  the  distinguished  mathematical  engineer  Anatole  Lurie  [1]  with  a 
set  of  nonlinear  control  differential  equations  of  great  generality. 

In  compact  vector-matrix  form  [2]  (with  an  improvement  due  to  Malkin, 
Lefschetz  and  V.  M.  Popov)  the  system  looked  like  this: 

{x  *  Ax  -  bq>(o) 

5  -  p(o) 

a  -  c'x  -  y? 

The  initial  uncontrolled  system  is 
( 1  * )  x  =  Ax 

The  notations  are:  x,  b,  c  are  n-vectors;  A  is  a  constant  n  x  n 

matrix;  greek  letters  represent  scalars.  (a)  is  the  characteristic 

of  the  control  and  one  assumes  these  properties:  m  is  continuous  for 

o 

all  91  y(0)  *0,  o  p(o)  >  0  for  o  ^  0;  # (a)  “i»(  s)da  (which  is  positive 

for  a  0)-»+  *  with  |a|. 

The  vector  x  is  the  state  vector:  b,c,y  are  control  para¬ 
meters;  ?  is  a  control  variable. 

Roughly  speaking  assuming  that  the  normal  position  for  x  is 
x  *  0#  given  small  deviations  of  x  one  hopes  that  by  imbedding  the 
system  ( 1 1 )  into  a  suitable  system  (l)  one  makes  (x,§)  -*  0  hence  x  -*  0 
as  t  ->+  «»  mathematically  speaking  in  Lurie's  monograph  there  is 
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imbedded  the  following  question  now  going  by  his  name  as 


Lurie's  problem.  To  find  n.a.s.c.  that  the  parameters  b,  c,  y, 
must  satisfy  in  order  that  all  solutions  of  ( 1 )  be  asymptotically 
stable  in  the  large  whatever  the  choice  of  an  admissible  function  <p(c) . 
This  is  absolute  stability. 

This  is  the  problem  that  I  propose  to  discuss  as  a  mathematical 
problem.  Regarding  its  practical  (R  and  D)  value  I  must  accept  the 
evidence  that  a  number  of  outstanding  mathematical  engineers  have 
"lovingly"  dealt  with  the  problem: 

Almost  all  the  work  done  on  the  Lurie  problem  is  an  application 
of  a  fundamental  theorem  due  to  Piapunov  plus  a  noteworthy  complement 
due  to  Barbashln  and  Krassovskii  -  lumped  in  what  I  will  refer  to  as 
the  L.B.K.  Theorem  --  together  with  a  highly  significant  observation 
made  by  J.P.  LaSalle  [3].  I  must  first  describe  these  basic  ideas. 

The  L.B.K.  Theorem.  Let 

(2)  u  =  U(u) ,  U(0)  =0, 

(u,  are  n-vectors)  be  a  real  system,  of  class  C1  throughout  the  whole 
n  space.  A  sufficient  condition  in  order  that  every  solution  u(t)  of 
(2)  -» 0  as  t  -»  +  0°  Is  the  existence  of  a  scalar  function  V(u)  of 
class  C1  for  all  u  with  these  properties 

(a)  V(u)  is  positive  definite  for  all  u[>  0  for  u  ^  0, 

V(0)  =  0]} 

(b)  V(u)-»  +  »  with  |  |u|  |  (Barbashin-Krassovskii  complement); 

(c)  since  V  is  of  class  C1  for  all  u  one  may  determine 
dV(u(t))/dt  =  V(u)  along  every  solution  u(t)  of  (2) 
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and  one  must  have  ^(u)  <  0  on  every  solution  except 
u  =  0. 

(Class  C1:  the  function  f(u)  =  f(u^,...,u  )  is  of  class  C1 
for  all  u  if  all  the  partials  df/dun  exist  and  are  continuous  for  all 
u.) 

We  state  LaSalle’s  complement  as  restricted  to  our  "control" 
situation  and  merely  remark  that  it  has  a  much  larger  range  of  appli¬ 
cation. 

.^-LaSalle's  complement.  The  L.B.K.  Theorem  still  holds  with 
•  •  « 

V  >  0  replaced  b£  V  <  0  under  the  condition  that  the  set  V  =  0  contains 

no  other  solution  than  u  =  0. 

Observation  about  Lurie 1 s  system.  There  are  actually  two 
distinct  situations  corresponding  to  y  /  0  and  y  =  0. 

I.  y  y  The  larger  system  is  of  dimension  n  +  1 .  This  is 
indirect  control.  Its  practical  significance  is  that  it  operates 
through  derivatives  and  hence  makes  possible  use  of  a  smaller,  less 
heavy  mechanism  than  the  initial  system:  Minorsky’ s  derivative  con¬ 
trol  initiated  this  method. 

II.  y  “  0:  direct  control.  The  order  of  the  system  is  un¬ 
changed.  Actually  in  this  case  g  plays  no  role  and  the  true  system 
i8 

(3)  x  =  Ax  -  b^(c'x). 

That  1%  controlling  is  obtained  by  adding  a  nonlinear  part  to  the  system. 

Now  if  one  assimilates  (x,g)  to  the  system  variable  Lurie's 
initial  equation  becomes 
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(4) 


x  -  Ax  -  bcoCc'x  -  Y§) 

&  =  «p(c'x  -  Y?) 

which  is  like  (3)  but  with  A  replaced  by  that  is  by  a  (nec¬ 

essarily)  singular  matrix.  This  has  led  many  authors  to  consider  (3) 
as  the  main  system.  Be  as  it  may  we  will  confine  most  of  our  dis¬ 
cussion  to  (l)  and  indirect  control  (y  ^  0) . 

Linearization.  At  all  events  if  absolute  stability  is  to  be 
obtained  the  system  will  have  to  be  at  least  asymptotically  stable 
when  ^(a)  =  \xa,  >  0.  It  will  then  become  linear  and  asymptotic 
stability  will  merely  demand  stability  of  the  coefficient  matrix. 

This  attack  was  first  persued  and  with  full  success  by  Yacubovich  [5]. 
It  is  actually  easier  to  deal  first  with  the  direct  control  (3).  The 
linearized  system  is 

(4')  x  =  (A  -  nbc')x 

and  so  the  matrix  A  -  nbc'  must  only  have  characteristic  roots  with 

negative  real  parts.  The  characteristic  equation  is  (zE  -  A  +  jibc’y 

=  0  ( E:  unit  matrix).  If  E  -  A  ■  A  ■  characteristic  matrix  of  A, 

z  z 

the  relation  becomes  |A  +  y.bc 1  |  =0.  A  simple  algebraic  manipula- 

z 

tion  reduces  this  to  the  equivalent  form 
1  +  uC'A^b  =  0 

Rather  simple  complex  analysis  yields  the  following  results: 

I.  No  characteristic  root  of  A  may  lie  to  the  right  of  the 
complex  axis.  Those  on  the  complex  axis  must  be  at  most  double. 


II.  Same  result  for  indirect  control  save  that  the  root  z  =  0 
must  be  at  most  simple. 

III.  Sufficient  conditions  for  the  asymptotic  stability  of  the 
linearized  indirect  control  for  small  ^  are:  A  stable  and  y  >  0. 

The  preceding  properties  point  out  the  relative  simplicity  of  an  in¬ 
direct  control  with  A  stable  (perhaps  only  feebly  so) .  This  is  the 
situation  that  we  propose  to  face  in  the  general  case.  As  a  first  step 
and  since  a  is  the  variable  appearing  in  f(a)  it  is  convenient  to  re¬ 
place  by  a  the  independent  variable  5  of  (l).  This  is  done  with  ease 
and  yields  the  equivalent  system 
« 

rx  «  Ax  -  by(a) 

(5)  <o  *  c'Ax  -  pqp (o) 

Ip  *  c’b  +  y 

Absolute  stability  suggests  recourse  to  the  L.B.K.  Theorem.  A  rather 
simple  form  of  Liapunov  function  is  obtained  (from  a  generalization  of 
one  due  to  Lurie-Poshukov  in  the  late  forties)  as 

(6)  V(x,o)  =  x'Bx  +  f (a) 

where  the  first  term  is  a  positive  definite  quadratic  form  that  is 
B  is  a  constant  symmetric  matrix  symbolically  described  by  B  >  0. 

Thus  V  behaves  in  accordance,  with  the  L.B.K.  Theorem.  Then  we  find 

(7)  -V  =  x'Cx  +  2d'xqp  +  p^2 
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(8)  -C  =  A'B  +  BA 

d  =  Bb  -  Jj-  A'c 

One  wishes  to  have  -V  >  0  for  all  x,a  and  not  both  zero.  This  re¬ 
quires  that  C  >  0.  An  early  result  of  Liapunov  asserts  that  given 
C  >  0,  there  is  a  unique  B  solution  of  (8)  and  B  >  0.  Thus  we  merely 
need  to  remember  C  >  0. 

Observing  now  that  (7)  is  a  quadratic  form  in  the  variables 
absolute  stability  will  be  achieved  if  one  makes  it  positive  de¬ 
finite  in  these  variables.  This  may  be  expressed  through  two  distinct 
modes  of  completing  sequences. 

(a)  by  leaving  c  unchanged  yielding  the  author’s  condition 


(9)  p  >  d'C-1  d  (hence  p  >  0); 

(b)  by  modifying  a  alone  —  as  done  by  Yacubovich  —  leading 
to  these  conditions: 


(10) 


rp  >  0;  existence  of 
Ia'B  +  BA  +  ^  <  0. 


of  a  B  such  that 


Thus  one  may  state. 

Theorem.  N.a.s.c.  to  have  V,V  satisfy  the  L.B.K.  Theorem  are  equi¬ 
valently  {C  >  0, (9))  or  (10).  when  this  happens  the  system  (l) 

(or  5)  ,1s  absolutely  stable . 

We  come  now  to  the  work  of  V.M.  Popov  [6]  beyond  doubt  the  most 
significant  contribution  to  the  Lurie  problem  since  Lurie.  The  system 
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dealt  with  is  the  Indirect  control  (l)  and  the  assumption  continues  to 
be  that  A  Is  stable  and  y  >  0.  Popov  proves  two  central  theorems. 
Stated  with  insignificant  deviations  from  Popov  they  are: 

Theorem  I.  A  sufficient  condition  for  the  absolute  stabil¬ 
ity  of  the  indirect  control  ( 1 )  JLs  the  existence  of  two  constants 

a  >  0,  $  >  0  such  that  for  all  real  u> 

111)  Re((2a  y  +  iwpH  c'AUh  +  ii)3  ^  0 

We  describe  {  }  =  P(a,0,u))  as  the  Popov  function. 

Theorem  II.  If  absolute  stability  is  determined  by  a  Liapunov 
function  of  type  "quadratic  form  3n  x,  a  plus  pi  (o) "  then  the  pre¬ 
ceding  theorem  holds  with  this  0  and  a  suitable  a  (a  maybe  zero) . 

Actually  Popov  showed  that  the  Liapunov  function  of  Theorem  II 
must  have  the  form 

V(x,c)  *  x’Bx  +  a(c  -  c’x)2  +  pf(o) 

Where  u,  0  are  those  which  appear  in  the  Popov  function. 

The  state  of  Theorem  I  does  not  bring  out  the  essential  simpli¬ 
city  of  the  result.  It  is  of  special  interest  when  a  ^  0.  Setting 
there  *  q,  one  may  replace  P  by  P(q,«)  =  ( 1+lwq)  (c'Aj^b  +  -jJ)  = 

(i+iwq)  (S1  (us)  +  lS^(is)). 

Hence  ( 1 1 )  becomes 

S1  (u>)  -  qtsSgfuj)  >  0. 

This  means  that  in  the  real  x,  y  plane  the  curve 
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r  :  X  =  S1  (iw) ,  y  =  u)S2(u)) 

has  a  tangent  y  =  qx  through  the  origin  in  quadrants  1,3  and  is 
otherwise  below  that  tangent.  Since  the  functions  S^u)),  SgCttj)  are 
rational  (hence  r  is  a  unicursal  curve)  the  discovery  of  a  tangent 
such  as  y  =  qx  is  a  rather  simple  matter  --  much  simpler  than  finding 
matrices  C  or  B  of  our  earlier  conditions. 

Open  problem  as  yet  unsolved:  Is  the  Popov  condition  (it) 
necessary  for  absolute  stability? 

Remark  about  Popov '  s  striking  proof  of  Theorem  I.  It  passed 
up  Liapunov  functions  and  replaced  them  by  very  advanced  Fourier  in¬ 
tegral  technique.  Curiously  a  transfer  function,  &  la  linear  theory, 
makes  its  appearance  in  the  inequality  (ll).  For  Popov's  function 
may  be  written 

(2ay  +  gz)(c'A‘1b  +  *)3Z  =  iu> 

and 

T(z)  =  c'A’1  b  +  \ 

is  the  transfer  function  (p(  a(t) )  to  a(t)  in  (5)« 

From  an  R  4  D  viewpoint  a  "sufficient  condition"  such  as  In 
Theorem  I  is  definitely  more  Important  than  a  necessary  one.  The  latter 
is  perhaps  more  Important  as  mathematics  that  as  R  4  D  information.  It 
may  be  added  also  that  the  proof  of  Theorem  II  is  far  easier  and 
simpller  than  that  of  Theorem  I. 
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Hardly  had  Popov's  expression  (ll)  appeared  on  the  scene,  than 
a  number  of  analogous  results  began  to  appear.  They  always  Involved 
some  pair,  V,  V  and  in  principle  proceeded  along  much  simpler  lines 
than  Popov's  first  theorem.  We  will  just  describe  one  very  interesting 
result  embodying  a  noted  lemma  of  Yacubovich  [7.1  strongly  improved  by 
Kalman  [8]  and  still  further  advanced  by  Kenneth  Meyer  [9].  We  will 
refer  to  it  as  the  Y.K.M.  lemma  (Meyer's  version  with  parts  omitted.) 

The  Y.K.M.  Lemma.  Assume  A  stable  and  let  b,  k,  be  real 
n-vectors  and  t  a  non-negative  constant.  If 

T  +  2  Re  k'  A-^  b  >  0 

for  all  real  w  then  there  exist  two  n  x  n  matrices  B  >  0,  D  >  0,  and 
a  real  n-vector  q  such  that 

A'B  +  Ba  =  -qq'  -  D 
Bb  -  k  ■  q. 

The  lemma  with  ">  0"  rather  than  ">  0"  was  proved  by  Yacubovich.  Under 
the  special  assumption  of  complete  controllability  of  (A,b)  and  complete 
observability  of  (A',c)  it  was  extended  (with  new  proofs)  by  Kalman. 

The  complete  controllability  and  observability  conditions  were  recently 
removed  by  Kenneth  Meyer. 

If  one  takes 

r. . 

K  »  A'c  +  aye,  t  »  Pp  -  Py  +  c'b 
then  the  inequality  of  the  lemma  reduces  to  Popov's  inequality  (ll). 
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One  has  then  this  result  of  Yacubovich  and  Kalman: 

Theorem.  Popov ' s  Inequality  with 

(a)  a  >  0,  3  >  0,  a  +  3  >  0 

(b)  t  >  0  or  t  =  0 ,  ^  0A'c  +  aye  =  0,  a  >  0 

are  n.a. s.c.  for  the  existence  of  the  Liapunov  function  of  the  second 
theorem  with  merely  -  V  >  0. 

Beyond  the  Lemma  and  under  certain  complicated  complementary 
conditions  given  by  Kalman  one  may  show,  using  LaSalle's  complement, 
that  absolute  stability  is  achieved. 

If  one  takes  Popov's  inequality  strictly  as  >  0  one  may  show 
that  V  and  -V  are  both  positive  definite  and  hence,  one  has  absolute 
stability. 

Noteworthy  work  has  been  done  recently  by  the  mathematical 
engineer  R.  W.  Brockett  and  his  young  associates  (see[7l).  Let  p(D), 
q(D)  be  real  polynomials  of  respective  degrees  n  and  at  most  n-1  in 
D  =  ^  .  With  <p(  o)  as  before  the  general  problem  which  they  have  at¬ 
tacked  is  the  scalar  real  differential  equation 

(12)  p(D)x  +  y(a)  =0,  a  =  q(D)x. 

and  its  absolute  stability. 

A  description  of  one  of  his  results  --  his  Theorem  4  --  will 
give  an  idea  of  his  general  procedure. 

Theorem.  Let  p(D)  =  Dh(L) ,  where  all  solutions  of  h(D)z  *  0 
are  asymptotically  stable.  Then  if  there  exists  an  r  >  0  such  that 
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m(z)  =  ( 1+rz)q(z)/p{z)  has  the  property  Re  m(z)  >  0  when  Re  z  >  0, 

(12)  is  absolutely  stable. 

To  indicate  the  nature  of  Brockett's  Liapunov  function  for  this 
case  vie  need  a  few  special  notations. 

(a)  If  g(z)  is  a  polynomial  let  gQ(z)  denote  the  polynomial 
made  up  of  its  even  terms; 

(b)  if  g(z)  is  real,  even,  and  such  that  3 ( iu>)  >0  for  all 
real  u>,  then  (Wiener)  g(z)”  =  k(z)k(-z),  k(z)  /  6  when  Re  z  /  0.  Set 
g ( z )  -  k(-z); 

(c)  denote  by  X  the  real  vector  whose  components  are  x(t), 
x(t),  x(t),...,x(n_l)(t). 

With  integration  in  the  space  of  X  the  form  of  Liapunov  func¬ 
tion  given  by  Brockett  is 

t(X)  P 

V(X)  "  J*.  .  ((a+BD)q(D)z  *  p(D)z  +  ((a  -  p  (l>)  q( -D)p(D) )  _z) d 
MO) 

+  0Dq(D)zf(q(D)z))dt 

One  may  show  that  V  is  positive  definite,  V  negative  semi-definite  for 
all  admissible  9,  then  using  LaSalle's  complement  one  proves  absolute 
stability.  Technique  of  similar  nature  has  been  used,  notably  by 
Willems  in  an  investigation  of  more  restricted  functions  ^p(o):  of  a 
differentiable  monotone  increasing  y(a) .  It  may  be  pointed  out  that 
the  first  term  of  the  expression  for  V(X)  (term  without  y)  is  essentially 
a  quadratic  form  in  X  while  the  second  term  is  really  the  same  as  the 
term  | (a)  of  the  earlier  Liapunov  functions. 
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A  number  of  authors  have  investigated  an  admissible  class  of 

characteristic  functions  q>(<r)  limited  by  an  additional  inequality 

0  <  <  X  (finite).  This  has  been  dealt  with  at  length  in  the 

o 

recent  book  [8]  by  Aizerman  and  Gantmacher,  which  incidentally  contains 
a  very  extensive  bibliography.  The  Popov  expression  ( 1 1 )  is  replaced 
by 


P(a,  0,  u),  X )  =  P(a,  0,  a»)  +  . 

The  modifications  for  indirect  control  are  moderate,  but  not  so  for 
direct  control,  which  require  replacing  the  pair  (V,  V)  by  (V,W) 
where  W  is  a  more  restricted  function  then  V,  and  depends  largely 
on  X . 


-22- 


PI 

aM.  i 


BIBLIOGRAPHY 


[1]  A.  I.  Lurie,  "On  some  nonlinear  problems  in  the  theory  of  auto¬ 
matic  controls",  H.  M.  Stationery  Office,  London  (1951) »  [Russian; 
English  translation] . 

[2]  A.  M.  Letov,  "Stability  of  nonlinear  controls",  (2nd  Russian  ed., 
1961:  [English  translation  of  1st  ed.,  Princeton  University  Press, 

1961  j. 

[3]  Solomon  Lefschetz,  "Stability  of  nonlinear  control  systems". 
Academic  Press,  1965. 

[4]  J.  P.  LaSalle:  see  LaSalle-Lefschetz,  "Stability  of  Liapunov's 
direct  method".  Academic  Press,  1961,  p.  66. 

[5]  V.  A.  Yacubovich,  "On  the  stability  in  the  large  of  undisturbed 
motion  for  the  equations  of  indirect  automatic  control",  [Russian], 
Vestn.  Leningr.  Univ.  ( 1 95 1 ) »  p.  19;  "On  nonlinear  differential 
equations  for  systems  of  automatic  control  with  a  single  control 
element*  ibid.,  p.  120-153*  i960;  "Solution  of  certain  matrix 
inequalities  occurring  in  the  theory  of  automatic  control", 

Doklady  Ak.  Nauk,  p.  1 43,  1304-1307,  1962;  "Absolute  stability 

of  nonlinear  control  systems  in  the  critical  cases",  Avtomat. 
i  tellemekh. ,  l4,  293-303  and  717-731,  1963. 

[6]  V.  M.  Popov,  "Absolute  Stability  of  nonlinear  systems  of  auto¬ 
matic  control",  22,  961-979,  1961. 

[7]  R.  W.  Brockett,  "On  the  stability  of  nonlinear  feedback  systems", 
Proc.  1964  JACC,  288-294,  See  also  R.  W.  Brockett,  and  J.  L. 
Willims,  "Frequency  domain  stability  criteria",  ibid,  1965, 

Part  I:  p.  735-74l,  Part  II:  p.  742-747. 

[8]  M.  A.  Aizerman  and  F.  R.  Gantmacher,  "Absolute  stability  of 
control  systems",  1963,  [Russian;  English  translation,  Holden- 
Day,  Inc.,  San  Francisco]. 


THE  BANG-BANG  PRINCIPLE 

by 

Lawrence  Markus 
Department  of  Mathematics 
University  of  Minnesota 


This  research  was  partially  supported  by  NONR  3776-(00). 


-24- 


The  Bang -Being  Principle 
by  Lawrence  Markus 


1 .  The  physical  significance  of  the  bang-bang  principle.  The 
bang-bang  principle  states  that  any  response  of  a  controlled 
system,  which  can  be  achieved  by  an  arbitrary  controller 
varying  over  the  total  control  domain,  can  equally  well  be 
achieved  by  a  controller  which  is  restricted  to  the  extreme 
values  of  the  control  domain.  The  term  "bang-bang”  refers  to 
the  abrupt  switching  of  the  controller  fran  one  of  these 
extreme  values  to  another.  In  engineering  design  it  is  often 
simpler  to  construct  a  control  device  with  only  a  finite 
number  of  positions  (say,  the  vertices  of  a  polyhedron)  rather 
than  a  continuum  of  possible  positions  (say,  all  the  points 
of  the  solid  polyhedron) ,  and  hence  the  bang-bang  principle 
is  of  great  practical  importance  -  when  it  is  applicable. 

The  bang-bang  principle  is  not  just  a  general  principle 
but  it  is ,  in  fact,  a  collection  of  precise  mathematical  theorems 
which  center  around  a  single  physical  concept.  The  basic 
mathematical  result  was  obtained  in  relatively  recent  times 
(1940)  by  the  Soviet  scientist  A.  Liapounov  [19L  who  thereby 
injected  a  new  method  -  and  also  a  new  Liapounov  -  into 
control  studies.  The  immediate  application  to  control  theory 
was  presented  by  J.  LaSalle  [  1 6]  in  a  fundamental  paper  in 
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i960.  Since  that  time  a  great  deal  of  research  has  developed 
the  applications  of  the  bang-bang  principle  to  control  problems, 
both  linear  and  nonlinear. 

As  a  simple  physical  control  process  consider  the  mechanics 
of  rowing  a  small  boat  across  a  smooth  lake.  The  controlling 
force  is  produced  by  the  two  oars  and  the  response  is  the 
heading  and  movement  of  the  boat.  If  both  oars  are  pulled 
simultaneously  with  equal  force,  the  boat  advances  in  a 
fixed  direction.  The  direction  can  be  changed  in  z  controlled 
manner  by  using  the  oars  together  with  each  stroke  but  pulling 
one  oar  more  strongly  than  the  other.  By  controlling  the 
difference  in  strength  of  the  two  oars,  a  continuum  of  control 
possibilities  arises. 

Now  consider  the  same  boat  controlled  by  "bang-bang 
rowing".  Here  the  oars  act  Independently,  but  always  with  the 
fixed  maximal  pulling  strength.  The  control  in  direction  is 
effected  by  using  one  oar  more  frequently  than  the  other. 

Thus  the  control  force  with  each  rowing  stroke  is  always  one 
of  two  extreme  values  (maximal  right  or  maximal  left),  but 
any  required  heading  of  the  boat  can  be  achieved,  even  if  not 
as  smoothly  as  before. 

Thus  in  the  bang-bang  control  we  replace  a  spatial 
variation  of  the  controlling  force  (the  resultant  rowing' 
stroke  can  range  over  a  continuum  of  angular  directions)  By 
a  temporal  variation  of  the  controlling  foroe  (the  frequencies 
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of  left  and  right  oar  strokes ).  From  this  viewpoint  the  bang- 
lung  prinoiple  resembles  ergodic  theory,  although  no  precise 
Interconnection  is  known  relating  these  two  disciplines. 

2.  The  bamt-banx  principle  for  linear  proeeeeee.  Consider 
t’e  first  order  vector  differential  system,  or  control  prooess, 

X)  1  *  Ax  +  Bu  . 

Here  x(t)  is  the  real  n-dlmenslonal  state  vector  at  each 
instant  of  time  t,  and  u(t)  is  the  real  measurable  control 
n-veotor.  The  coefficients  A  and  B  are  real  constant  matrices. 

We  fix  the  initial  state  Xq  in  the  real  vector  space  B11 
and  choose  various  control  functions  u(t)  on  0  <  t  <  •  to 
determine  the  response  x(t)  as  the  solution  of  the  Initial 
value  problem 

jf  *  Ax  +  Bu(t)  ,  x(0)  •  Xq  . 

The  controllers  are  arbitrary  measurable  functions  with  values 
restricted  to  a  prescribed  nonempty  compact  restraint  set 
0  c  H*  .  Tor  eaoh  time  tj  2  0  define  the  set  of  attainability 
Z  (tj)  to  consist  of  all  endpoints  x(t.,)  to  responses  initia¬ 
ting  at  Xq9  for  all  possible  controllers  u(t)  cllonO<t<<t1 

Definition.  Consider  the  linear  eontrol  process  in  B11 

X)  i  ■  Ax  +  Bu 

with  initial  state  Xq  at  t  •  0,  and  compact  restraint  set 
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ft  r  h®  .  For  each  compact  subset  Z  c  Qve  define  the  set  of 
attainability  Ks(tj)  from  xQ  by  controllers  u(t)  c  Z  on 
0  <  t  <  t1  •  We  state  that  Z  has  the  bang-bang  property  in 
case  K^Ctj)  *  K^(t^)  for  all  t1  j>  0  • 


If  ft  Is  a  ooapact  convex  set,  then  la  also  compact 

and  convex.  This  follows  from  the  Tarlations  of  parameter 
formula  for  the  response 


x(t  j 

Since  the  map 
uC) 


eAtxQ  +  eAt  J  e“A®Bu(s)ds  . 

0 

f*  i 

J  e-AsBtt(.)dt:  Xi.  (O.t,)  -  H° 


Is  linear  and  compact,  the  properties  of  convexity  and 
compactness  of  ft  are  shared  by  K^(t1 ).  The  following  theorem 
shows  that  K^(t.,)  *  ^((1)^1 )  »  w^ere  H(ft)  Is  the  convex  hnll 
of  ft  •  Hence  K^tj)  Is  compact  and  convex  even  if  Q  la  an 
arbitrary  compact  set. 

Theorem  1.  Consider  the  linear  control  process  In  H11 
JL)  ±  =  Ax  +  Bu 

with  Initial  state  Xq  at  t  *  0  ,  and  compaot  restraint  met 

ft  c  R®.  Let  Z  be  a  compact  subset  of  A  with  the  same  oonvex  jmll 

H(Z)  -  H(ft)  . 

Then  Z  has  the  bang-bang  property  Z£(t.,)  *  K^(t  1 )  for  all  t^  £  O* 
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The  proof  of  theorem  i  wae  presented  by  L.  ?Teustadt  [22] 
ju*G.  involyes  intricate  functional  analysis  and  the  basic 
theorem  of  A.  liapounor,  which  will  be  discussed  in  recti on  3. 

Corollary  1.  Let  Z  be  the  boundary  Ml  in  R*.  Then  3  has 
the  bans-bans  property. 

Corollary  2.  Let  A  be  a  conrex  polyhedron  in  E®,  and  let  Z 
be  the  eat  of  yertloee  of  II.  Then  Z  has  the  bang-bans  property. 

fhe  theorem  of  LaSalle  corresponds  to  Corollary  2  in  the 
eaee  where  II  is  an  m-cube. 

A  eomewhat  more  general  and  rery  recent  result  [23] 
aeeerte  that  the  set  of  extreme  points  of  H(il)  has  the  bang- 
I  tag  property  (eren  if  this  set  Is  not  compact ). 

The  oonrerse  of  Theorem  1  cannot  hold  in  general.  For 
enppoee  B  -  0,  then  any  subset  of  A  has  the  same  (unique) 
reeponee  and  so  possesses  the  bang-bang  property.  In  order  to 
consider  processes  in  which  the  oontrols  hare  some  reasonable 
effect  we  introduce  the  concept  of  a  (completely)  controllable 
process. 

Definition.  Consider  the  linear  process  in  R® 

X)  1  -  Ax  +  Bu 

with  no  restraint  on  the  controllers.  Suppose  for  eaoh  pair 
of  points  Xq  and  x1  la  if*  there  exists  a  bounded  measurable 
controller  steering  xQ  to  x^  on  some  0  <  t  <  t.,.  Then  JL 
la  (completely)  controllable. 
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It  is  well  known  [14]  that  JL  is  controllable  if  and  only  if 

rank  [B,AB,A2B,... , «  n  . 

The  condition  that  the  nxnm  controllability  matrix  should 
have  maximal  rank  n  is  "generic Mj  that  is,  every  linear  process 
can  be  approximated  by  controllable  processes  and  also  the 
property  of  controllability  is  maintained  under  perturbation. 

From  this  algebraic  condition  it  follows  that  X  is  controllable 
if  and  only  if  1  *  -Ax  -  Bu  is  controllable,  and  this  obtains 
just  in  case  each  initial  state  Xq  €  B11  can  be  steered  to  the 
origin  in  a  finite  time  duration  by  some  bounded  measurable 
controller.  We  prove  a  slight  extension  of  this  result. 

Theorem  2.  Consider  the  linear  process  _in  B11 

X)  *  *  Ax  +  Bu 

with  Initial  state  xQ  at  t  *  0  and  compact  restraint  set  H 
with  interior  in  B®  .  Then  the  set  of  attainability  X(t.,)  is 
a  convex  body  (with  interior)  for  each  t ^  >  0  if  and  only  if 

rank  [B,AB, A2Bf ...f A^B]  *  n  . 

Proof. 

The  set  K(t^)  is  a  compact  convex  set  in  B®.  First  assume 
that  the  rank  of  the  controllability  matrix  is  less  than  n. 

Then  there  is  a  unit  row  n-vector  v  such  that 

▼B  *  vAB  -  tA2B  ■  ...  -  tA^B  -  0 
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1  f  Using  the  Cayley-Hamllton  theorem  we  oompute 
▼A*B  ■  0  for  k  ■  n,  n+1,  ...  • 


:  V  < 

■  l 


Henoe 


veAtB  -  0  for  all  t  >  0. 


But  K(t.)  le  the  eet  of  all  endpoints 

ti 

At.  Ati  f  a ■ 

x(t.,)  *  e  'xQ  +  e  1  J  e“,ABBu(a)da 

for  controllere  u(t)  cAonO  <  t  <  t*.  Thue 

At  1 

▼[K^)  -  e  }xQ]  -  0 


and  so  K(t.j)  la  a  translate  of  a  subset  whioh  lies  in  the 
hyperplane  orthogonal  to  t.  Therefore  K(t1 )  has  no  Interior 
points. 

Conversely  assume  that  the  ocntrollablllty  matrix  has 
rank  a  .  Suppose  that  K(t.,)  has  no  interior  and  that  there 
Is  a  unit  veotor  v  for  whioh 

Ati 

▼[Kftj)  -  e  Xq]  ■  0  ,  for  some  t1  >  0  • 


In  this  oase 


-*1  A{tr§) 

j  ▼  e  B(u0  +  u(a))ds  “ 


where  Uq  is  a  oonstant  in  the  interior  of  ft  and  u(s)  is  an 
arbitrary  oontroller  near  sero.  Then,  for  u(s)  ■  0  we  obtain 


Pt1  A(t.-e) 

J  v  e  B  Uq  de  ■  0 

0 


and  so 


J 


1  A(tr0) 

v  e 


B  u(s)d8 


0  . 


0 

Since  this  equality  holds  for  all  small  controllers , 
Aft.-e) 

v  e  B  "  0  on  0  <  a  <  t.,  . 


Set  s  ■  t1  to  get  rB  *  0  •  Next  differentiate  with  respsot 
to  s  and  set  s  ■  t1  to  get  v  AB  *  0.  Continue  In  this  way  to 
obtain 

vB  -  yAB  -  vA2B  «  ...  -  TAn-1B  -  0 


But  this  contradicts  the  hypothesis  that  the  n  rows  of  the 
controllability  matrix  are  independent.  Therefore  K(t -j )  le 
a  convex  body.  Q.E.D. 

Corollary.  The  linear  prooeee  SL  le  oontrollable  In  RD  (with 
no  control  reetraint)  If  and  only  if 

rank  [B,AB,A2B,...,An"1B]  -  n  . 

Proof. 

Aseume  that  the  controllability  matrix  has  rank  n  and 
take  the  unit  n-oube  oentered  at  the  origin  as  the  restraint 
set  A.  Then,  using  controllers  inft  on  0  <  t  <  1,  we  oan  „ 

steer  the  origin  xQ  ■  0  to  any  point  x^  in  a  neighborhood 

'  \ ' 
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N.  By  the  linearity  of  X  ,  r >ntrollers  in  kft.  steer  Xq  to  all 
points  in  UT,  for  k  ■  1,2,3,...  .  Thus  xQ  oan  he  steered 

to  any  point  x^  €  Rn  by  a  bounded  controller  u(t)  on  0  <  t  <  1, 
Sinos  this  sane  conclusion  holds  for 

-X)  ±  -  -Ax  -  Bu  , 

wo  oan  rererse  the  tine  sense  and  steer  x^  to  iQ  «  0.  Hence  X 
Is  controllable. 

Hext  as  suae  that  the  rank  of  the  controllability  matrix 
is  less  than  n.  In  this  case  there  is  a  nonvanishing  rector 
r  such  that 

▼B  -  rAB  -  tA2B  -  ...  -  ▼An“’1B  *  0  . 

But  this  Implies  that  reAtB  ■  0  and  so 

f*1 

▼  J  e  Bu(s)ds  ■  0  . 

0 

Henoe  the  origin  Xq  «  0  oan  be  steered  only  to  points  in  the 
hyperplane  orthogonal  to  ▼,  and  X  falls  to  be  controllable. 

Q.  E.  B* 

Theorem  3.  Consider  the  controllable  prooeas  in  Ra 
X)  *  «  Ax  +  Bu 

with  Initial  state  xQ  at  t  ■  0,  and  compact  restraint  set  A 
with  interior  in  R*.  Assume  rank  B  *  m. 


Then  a  oonpaot  subset 


Proof* 

By  theorem  1  a  compact  subset  Z  with  H(Z)  *  H(fl)  has  the 
bang-bang  property,  and  we  prove  the  converse  under  the  above 
hypotheses. 

Assume  H(Z)  /  H(ft)  so  that  there  exists  a  point  in  H(fl) 
which  is  separated  by  a  hyperplane  from  H(Z).  Thus  there  exists 
a  supporting  hyperplane  n  to  H(O)  such  that  n  falls  to  meet  H(Z). 

Now  let  Pq  be  a  boundary  point  of  K^t-j)  •  kh(q)^i *or 
any  fixed  t1  >0.  let  t)q  be  any  external  unit  (row)  vector 
normal  to  a  supporting  hyperplane  to  K^(t  1 )  at  Pq.  Then 
any  controller  ^(t)  c  H(0)  on  0  £  t  <  t1  which  steers  Xq  to 
Pq  necessarily  satisfies 

At.  At.  1*1 

rj0[e  Xq  +  e  M  e"ABB  u0(s)dsj 

At.  At.  i^l 

>  Tj0[e  ’xq  +  e  J  e“A8Bu(s)ds]  * 

0 

where  u(t)  c  H(n)  is  an  arbitrary  controller.  Thus  uQ(t) 

satisfies  the  maximal  principle  [4] 

At .  At .  ix 

ru  e  e  Bun(t)  ■  max  nA  e  e  Bu  , 

0  0  u  €  H(fl)  0 

almost  always  on  0  <  t  <  t1  . 

Consider  the  linear  map  of  Rn  into  R® 

T|  — »  T)  B  • 

Since  rank  B  ■  m,  we  can  find  a  (row)  veotor  T)1  such  that 
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t)^B  la  along  the  outward  normal  to  the  hyperplane  n. 

■•ana  that 


At. 

max  n.  e 
u  €  H(n)  1 


Bu 


This 


assumes  its  maximum,  for  each  t  near  t.,,  only  on  H(fl)  -  H(Z). 

Let  Pj  €  &  K^(t^)  be  a  point  where  r)1  is  an  outward 
directed  normal  to  Z^(tj).  Then  P1  cannot  be  attained  by  any 
oontrollsr  restricted  to  H(Z),  sinos  any  such  controller  cannot 
satisfy  the  necessary  maximal  principle*  Therefore  w  * 

K^( 1 1 )  and  Z  falls  to  hare  the  bang-bang  property.  Q.B.D. 


Corollary.  If  fl  is  also  oonrex,  then  a  compact  zc|)  has  the 
bamr-bamt  property  if  and  only  if  Z  contains  all  the  extreme 
points  of  fl. 


3«  A.  Llapounor’s  theorem  and  some  generalisations.  In  this 
seotlon  we  present  a  dlsoussion  of  Liapounoy's  theorem  on  the 
oonrexlty  of  the  range  of  a  rector  measure. 

Let  y(t)  be  a  bounded  measurable  n-reotor  function  on 
0  <  t  <  1.  Let 3  be  the  o-algebra  (Borel  <r- field)  of  all 
Lebeegue  measurable  subsets  of  0  <  t  <  1. 


Theorem  4  (A.  Liapounor).  Por  eaoh  set  S  6  3  consider  the 
point  in  Hn 


and  let 


Xj  -  I  y(t)dt  , 

E 

be  the  set  of  all  such  points  x.. 


K 


Then  K  is  oonrex 


and  compact* 

Proof  (sketch). 

First  construct  a  continuous  family  of  sets  63 

0  <  a  <  1  with  c.  D  if  and  only  if  a,  <  aot  and  the 
—  —  a1  a2  *  —  « 

Lehesgue  measure  of  Ba  is 
H(Da)  *  «  • 

Such  a  continuous  family  is  easily  obtained  [8]  as  a  maximal, 
linearly  ordered  (by  Inclusion)  chain  of  sets  in  3,  with  the 
aid  of  the  axiom  of  choice. 

We  use  Dff  and  the  first  component  y.,(t)  of  y(t)  to 
construct  a  e-algebra  Xy  c3  whereon 

r  r1 

'  y1  (t )dt  *  |*(E)  J  y,(t)dt  . 

E  0 

To  construct  first  take  E1  €  3  whereon 

r  if1  i 

I  y^t)dt  -  7  .1  y-,  (t )dt,  |*(E1 )  -  7  . 

E^  0 

The  existence  of  follows  from  the  properties  of  the  family 
Dff.  Namely, 

n(Da  -  Vl/2}  "  on  1/2  <  a  <  1 

and  the  integral  of  y^(t)  oxer  (Da  -  Da-1^2)  *■  «  continuoua 
function  /(a)  such  that  ‘ 

Jfll)  V2 )  «  1/2  4  yi(t)dt  . 
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Thus  for  some  Intermediate  a.  on  1/2  <  a  <  1  we  obtain 
f1  i  -  - 

/(o^)  *  1/2  J  y.j(t)dt  ,  aa  required. 

Next  partition  E1  and  Eg  *  [0, 1 ]  -  E1  into  two  appro¬ 
priate  subsets  E^  and  E^,  Eg  on  each  of  which 

f  y^tjdt  -  j  ryi(t)dt  ,  m(E)  -  1/4  . 

Continue  this  partitioning  to  obtain  a  countable  collection 
of  such  sets  E  and  then  let  A.  1  be  the  o-algebra  generated  by 

all  these  sets.  Since  I  y^(t)dt  and  u(E)  are  each  signed 

E 

measures  defined  on  ,  and  since  they  are  equal  (up  to  a 
constant  factor)  on  the  algebra  generated  by  the  above 
oountable  family  E1t  Eg*  E y  E^t  E^*  Eg,  ...  *  we  obtain 

J1 


r 

J  yi(t)dt  •  u(E)  J  y^ (t)dt  * 
E  0 


for  all  E  ( 

Next  repeat  the  above  argument  to  select  c-algebras 
•j^n  c  c  ...  cA1  ci  such  that 

/ 


y(t)dt  ■  m(E)  f  y(t)dt 
E  0 


for  E  *  A  . 

n 


Finally  we  prove  the  convexity  of  the  set  K.  Suppose  F 


1 


and  Fg  are  in  3  with 


J 


y(t )dt  *  a.  ,  J  y(t )dt  *  a2  , 
F-j  1  ?2 

and.oonsider  the  Intermediate  point 


Xa,  +  (1-X)a2  ,  0  <  X  <  1 
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y 


Consider  the  2n-vector 


7*(t) 


*y(t)  X^t)' 
y(t)  x2(t) 


with  the  characteristic  functions  X^(t)  of  P.,  and  X2(t)  of  P2* 
Let  A  c3  he  a  o-algebra  whereon 


r  r 

■'  y*(t)dt  -  u(E)  J  y*(t)dt  -  »*(E) 

E  0 

Let  Da  with  |A(Da)  ■  a  be  a  continuous  faally  of  sets  in  A  and 

'a fine 


P  *  (Dx  n  Pj)  U  [([0,1]  -  Lx)  0  P2]  . 


Then 

f  y(t)dt  »  J  y(t)Xi(t)dt  +  [  y(t)x2(t)dt 

P  Dx  1  [0,1 j-D* 

so 

r 

J  y(t)dt  *  Xa^  +  (1-X)a2  , 

F 

and  hence  K  is  oomrex. 

The  ooapactness  follows  fron  arguments  of  functional 
analysis  which  we  shall  not  indicate  here.  Q.E.D. 

Remarks.  Let  us  indicate  the  proof  of  the  convexity  of  K^(t^ ), 

as  In  theorem  1.  Let  ua(t)  and  u^(t)  c  A  on  J)  t  0  <  t  <  t1  he 

two  controllers  with  responses  xft(t)  and  x^(t)  Initiating 

at  x.  when  t  ■  0.  Por  eaoh  measurable  subset  D  c«  oonslder 
o 

the  real  2n-reotor 
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w(S) 


\l  e"As  B  ua(fl)ds 

!  --As 


|  6  —  B  U|j(s)d8 
The  vector-  valued  set  function  w(D)  has  values 


*U» 


and  w (fS) 


By  Llapounov ' s  theorea  there  is  a  set  c«Pfor  which 


w(D. ) 


and  w(«^  -D^  )  *  ( 1-X ) 


rra 

rb  • 
L  J 


Define  the  controller,  for  0  U  <  1  , 

(ua(t)  for  t  € 


•C 


|u^(t)  for  t  €%0 
Then  the  corresponding  response  leads  to 


*X<V 


At, 


At 


xo  +  8 


'(l 


e*1  8  Bua(s)ds  *  J  e“  8  Bu^(s)ds 


^(tj)  •  Xx^tj)  +  (i-x)xb(t1)  . 

Thus  K^(t^ )  Is  convex  for  an  arbitrary  compact  restraint  set  0. 

We  note  that  the  bang-bang  principle,  say  in  the  case  of 
a  ooznrex  polyhedron  0,  merely  asserts  that  the  required  control 
can  he  attained  by  a  controller  resting  at  each  vertex  of  II 
for  soae  measurable  duration  of  tine.  Tt  is  of  great  interest 
to  find  bang-bang  controllers  which  are  piecewise  constant; 
which  have  only  a  finite  number  of  switches  rather  than  a 
oomplloated  measurable  switching  set.  Such  results  have  been 
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obtained  by  H.  Halkin  [9,10,11]  and  R.  Levinson  [18],  In 
their  analyses  the  coefficient  matrices  A(t)  and  B(t)  can 
vary  analytically  with  tine  and  need  not  be  constant*  For 
arbitrary  integrable  coefficient  matrices  the  bang-bang 
principle  holds ,  but  the  switches  may  well  be  necessarily 
Infinite. 

Another  Interpretation  of  the  bang-bang  principle 
restricts  the  controllers  to  be  extreme  functions  rather  than 
functions  with  values  in  the  set  of  extreme  points  of  A*  That 
is,  let  n  be  a  compact  convex  set  in  H*  with  extreme  point  set 
W.  Then  theorem  1  asserts  that  W  has  the  bang-bang  property, 

Kjt,)  *  K^)  for  t,  >  0  . 

The  set  of  all  measurable  controllers  (almost  always)  in  Q 
is  a  weak  *  compact,  convex  set  in  the  space  K  of  all  essen¬ 
tially  bounded  measurable  n-vector  functions  on*0  :  0  <  t  <  tj* 

A  theorem  of  S*  Karlin  [15]  asserts  that  the  extreme  points 
of  the  set  are  among  the  controllers  having  values  in  W* 

If  W  *  W,  the  extreme  points  of  are  precisely  the  controllers 
in  W. 

4*  Nonlinear  bang-bans  phenomena.  Consider  the  nonlinear 
control  process 

X  »  f(x,u) 

n<HB.  The  state  x(t)  at  each  time  t  is 
-4o- 


where  f(x,u)  f  C'  in  R 


a  real  n-veetor  and  the  control  u(t)  la  a  measurable  m-vector 
function  with  nines  In  ease  restraint  set  ft  e  R®.  We  seek 
to  steer  an  lnitall  state  Xq  to  the  origin  x1  *  0  in  some 
finite  tine  interval  0  <  t  <  t1  by  a  controller  in  A*  Since 
the  process  is  nonlinear,  the  response  x(t)  to  a  controller 
u(t)  c  fl  on  0  <  t  <  t1  sight  not  exist  for  the  entire  duration, 
and  hence  it  is  reasonable  to  consider  just  strictly  local 
control  problem  for  short  tiae  durations. 

Bnaale.  Consider  the  scalar  prooess  in  H* 

•  2 
x  *  u  +  u 

with  restraint  ft:  |u|  <  2.  Then,  since  the  linear  approxlma- 

e 

tlon  near  x  «  u  ■  0  is  the  controllable  process  x  ■  u,  each 
point  Xq  near  x^  ■  0  can  be  steered  to  the  origin  by  a  controller 
in  ft.  However,  if  we  use  only  bang-bang  controllers  with 
]u(t)  ]  ■  2,  then  x(t)  >  0  and  so  points  Xq  >  0  cannot  be 
steered  to  the  origin. 

The  difficulties  illustrated  by  the  above  example  are 
resolved  by  the  following  the  ores  [20,21]. 

Theorem  5.  Consider  the  control  process  in  R11 

s&)  x  »  f(x,u)  in  C*  in  Rn^*. 


Assume 
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1)  f(0,0)  «  0 


-  n 


Let  %  be  a  fixed  confer  polytope  wit&  the  origin  in  its 
terior  in  E®.  Then  there  exists  an  c  >  0  and  *  neighborhood 
TT  of  x1  «  0  such  that: 

each  initial  state  Xq  €  IT  can  be  steered  to  x^  *  0 
by  a  measurable  controller  u{t )  cn  0  <  t  <  1  with  nlsw 
only  In  the  finite  set  of  Tortioea  of  the  similar  polrtww  cm. 

finally  let  us  turn  to  the  nonlinear  global  control  problem 
with  bang-bang  controllers.  To  insure  global  stability  about 
the  origin  x1  *  O  we  Impose  the  classical  hypothesis  of  A.  S. 
LiapounoT.  The  bang-bang  analysis  is  treated  by  the  methods 
of  A.  LiapounoT.  In  this  Banner  we  are  able  to  obtain  the 
•following  result. 

Theorem  6.  ( Mapounor- LiapounoT ) .  Consider  the  control 
process  in 

J)  ±  «  f(xtu)  in  C»  1b  R314*  . 

Assume  that  there  exists  a  real  function  T(i)  ia  C*  in  H* 
such  that: 

1)  V(x)  >  0  for  x  4  0  and  T(0)  *  0 

2)  lie  V(x)  -  - 


2)  rank  [B,  AB,A2B, . . .  .A^B] 

df(0#0) 


where  A  «  — and  B 


ix 


3u 


Also  assume 


4)  f(0,0)  -  0 

5)  rank  [B,AB,A2B . An_1B]  -  n 

whjgt  *  -  ^(0t0>  SSI  B  -  . 

&X  du 

Then  thsrs  exists  am  e  >  0  such  that  erery  Initial  point 
Xq  €  can  bs  steered  to  x1  *  0  In  a  finite  time  by  a  measur¬ 
able  controller  u(t)  each  of  whose  components  takes  on  onl 


BIBLIOGRAPHY 


1.  Bellman,  R. ,  Gliokeberg,  T. ,  Gross,  0.,  On  the  "hang-bang" 
control  problem.  Quart.  Appl.  Hath.,  Vol.  14  (1956),  pp.  11-18. 

2.  Blackwell,  D. ,  The  range  of  certain  vs ct or  integrals,  PAMS, 

Vol.  2  (1951),  pp.  390-395. 

3.  Castalng,  Sur  une  extension  du  theorems  de  Lyapounov,  C.  R. 
Paris  260,  pp.  3838-3841. 

4.  Boltyanski,  Y. ,  Gamkrelldse,  R. ,  Mishohenko,  E. ,  Pontryagin, 

L. ,  The  mathematical  theory  of  optimal  prooeeees. 

5.  Dvoretsky,  A.,  Wald,  A.,  Wolfowits,  J. ,  Relatione  among 
certain  ranges  of  vector  measures,  Pao.  J.  of  Math.  (1951). 
pp.  59-74. 

6.  Fattorini,  H. ,  Time  optimal  control  of  solutions  of  opera¬ 
tional  differential  equations,  J.  SIAM  Control,  Yol.  2  (1964)* 
pp.  54-59. 

7.  Filippov,  A.,  On  oertaln  questions  In  the  theory  of  optimal 
control,  J.  SIAM  Control,  Vol.  1  (1962),  pp  76-84. 

8.  Halkln,  H. ,  On  the  necessary  condition  for  optimal  control 
systems,  J.  d 'Anal.  Math.  19  (1964),  pp.  1-82. 

9.  Halkln,  H. ,  A  generalisation  of  LaSalle's  "Bang-Bang" 

Principle,  J.  SIAM  Control,  Vol.  2  (1965),  pp.  199-202. 

10.  Halkin,  H. ,  On  a  generalisation  of  a  theorem  of  Lyapounov, 

J.  Math.  Anal,  and  Appl.,  (to  appear) 

11.  Halkln  H. ,  Some  further  generalisations  of  a  theorem  of 
Lyapounov,  Arch.  Rat.  Meoh.  Anal.,  (to  appear). 

12.  Halmos,  P. ,  The  range  of  vector  measure,  Bull.  Am.  Math. 

Soc.,  Vol.  4  (1953),  PP.  603-610. 

13.  Hermes,  H. ,  A  note  on  the  range  of  a  veotor  measure i 
application  xo  the  theory  of  optimal  oontrol.  BIAS  Tech, 
report  (1963). 

14.  Kalman,  R. ,  Ho,  Y. ,  Narenda,  K. ,  Controllability  of  linear 
dynamioal  systems,  Contrlb.  of  Diff.  Eq. ,  Yol  1  (1962). 

15.  Karlin,  S.,  Extreme  points  of  veotor  functions,  BAMS, 

Vol  4.  (1953),  pp.  603-610. 


-44- 


LaSalle,  J. ,  The  time  optimal  control  problem,  Contrib. 
to  Nonlinear  Oeoil. ,  Vol.  5,  pp*  1-24  (i960). 

Lee-Markus,  Foundations  of  Optimal  Control  Theory  (to  appear 
in  1966). 

Lerlnaon,  N. ,  Minimax,  Liapounov  and  "bang-bang",  MIT  J. 

(to  appear). 

Liapounov,  A.,  Stir  lee  fonctions-vecteurs  completment 
additives.  Bull.  Aoad.  Sci.  USSR,  Vol. 4  (1940),  pp.  465-478. 

Markus,  L.,  Controllability  of  nonlinear  processes,  SIAM 
Control  J. ,  Vol.  3  (1965)* 

Markus,  L«,  Controllability  and  Observability.  Proo.  of 
Symposium  on  Optimal  Control  in  Ravello  (1965). 

Heustadt,  L. ,-  The  exlatenoe  of  optimal  control  in  the  absence 
of  oonvexlty,  J.  Math.  Anal,  and  Appl. ,  Vol  7  (1963)# 
pp.  110-117. 

Sonneborn,  L.,  Van  Vleok,  F. ,  The  bang-bang  principle  for 
linear  oontrol  systems,  J.  SIAM  Control,  Vol.  2  (1964), 

PP.  (151-159). 

Datko,  R. ,  A  general  bang-bang  prinolple  and  bang-bang 
approximations.  J.  SIAM  Control,  Vol  10  (1965),  pp  284-294. 

Talb,  P. ,  Infinite  dimensional  oontrol  problems  I.J.  Math. 

An.  and  Appl.,  Vol.  9  (1964)#  pp.  12-22. 


4  t 


-45- 


DOCUMENT  CONTROL  DATA  -  R  &  D 

(Security  classification  of  title,  body  o (  abstract  and  indexing  annotation  must  be  entered  when  the  overall  report  Is  classified) 


Department  of  Mathematics 
Washington,  D.  C.  20007 


3.  REPORT  TITLE 


26.  CROUP 


LECTURE  SERIES  f N  DIFFERENTIAL  EQUATIONS 
SESSION  1:  CONTROL  THEORY 


3-  AUTHOR'S)  (First  name,  middle  initial ,  last  name) 


George  B.  Dantzig,  Solomon  Lefschetz,  Lawrence  Markus 


6.  REPORT  DATE 

November  1965 


7a.  TOTAL  NO.  OF  PAGES 

48 


76.  NO.  OF  REFS 

37 


8a.  CONTRACT  OR  GRANT  NO. 


AF-AFOSR  984-66 


9a.  ORIGINATOR'S  REPORT  NUMBER (S) 


6.  PROJECT  NO. 


9749-02 


6144501F 
d ■  681304 


96.  OTHER  REPORT  NO(S)  (Any  other  numbers  that  may  be  assigned 
this  report) 

•fFOSR  65-1886 


3*  Each  transmittal  of  this  dosiassat  or*,  si :.e  tl  ..*5  c£  tha 

0.  S.  Government  must  have  prior  approval  of  A-  voA  VCF.G6). 


II.  SUPPLEMENTARY  NOTES 

TECH,  OTHER 


4.  DESCRIPTIVE  NOTES  (Type  of  report  and  inclusive  dates) 

Scientific  Interim 


13.  ABSTRACT 

This  Scientific  report  summarizes  the  three  lectures  presented  at  the  First  Session 
of  the  Lecture  Series  in  Differential  Equations,  sponsored  by  the  AFOSR,  and  the 
Graduate  Consortium  of  American,  Catholic ,.  Georgetown ,  George  Washington  and  Howard 
Universities  of  the  District  of  Columbia  and  the  University  of  Maryland,  and  held 
at  Georgetown  University,  2  October  1965. 


Air  Force  Office  of  Scientific  Research( 
1400  Wilson  Boulevard 
Arlington,  Virginia  22209 


The  First  Session,  on  Control  Theory,  included  lectures  by  Professors  G.  B.  Dantzig, 
S.  Lefschetz  and  L.  Markus.  Professor  Dantzig  illustrated  how  mathematical  pro¬ 
gramming  ,  v  in  particular  a  generalized  linear  program,  can  be  applied  to  a  linear 
control  process.  The  "problem"  takes  the  form  of  minimizing  the  "cost"  of  moving 
an  "object"  from  one  convex  domain  to  another  by  proper  choice  of  a  control  vector 
and  boundary  conditions. 


Professor  Markus  discussed  the  "bang-bang"  theory  of  control  as  a  physical  concepc 
and  as  a  collection  of  precise  mathematical  theorems.  The  bang-bang  principal  stat$.sr 
that  any  response  of  a  controlled  system  which  can  be  achieved  by  an  arbitrary  con¬ 
troller  restricted  to  the  extreme  values  of  the  control  domains.  Theorems  presented 
relate  both  to  linear  and  nonlinear  control  processes. 


12.  SPONSORING  MILITARY  ACTIVITY 


Professor  Lefschetz  dealt  with  the  Lurie  problem  on  nonlinear  controls,  i.e.,  the 
determination  of  necessary  and  sufficient  conditions  such  that  all  solutions  of  a 
set  of  general  nonlinear  control  differential  equations  are  absolutely  stable  in 
the  large  whatever  the  choice  of  the  admissible  (function)  characteristic  of  the 
control . 


DD 


FORM 

1  NOV  35 


1473 


■ 


Security  Classification 


•*r 


SBB&SEi 


curity  Classification 


HOLE  I  W  T 


ordinary  differential  equations 
linear  ordinary  differential  equations 
nonlinear  ordinary  differential  equations 
control  theory 
mathematical  programming 
"bang-bang"  theory  of  control 


Security  Classification 


